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BACKGROUND  AND  INTEREST  MEASURES  AS  PREDICTORS  OF  SUCCESS 
IN  UNDERGRADUATE  PILOT  TRAINING 


1.  INTRODUCTION  AND  BACKGROUND 

Over  the  years  a great  deal  of  attention  has  been  focused  on  decreasing  training  costs  by  developing 
techniques  to  select  individuals  foi  training  progrants  who  are  most  likely  to  succeed.  Today  with  the 
stringent  budgetary  limitations  imposed  by  Congress  on  military  spending,  more  emphasis  titan  ever  has 
been  placed  on  the  armed  services  to  find  ways  of  maximizing  the  return  on  their  training  investment.  The 
most  costly  type  of  training  in  the  Air  Force  is  the  training  of  pilots.  Although  the  cost  of  undergraduate 
pilot  training  varies  depending  on  which  costs  are  included  or  excluded  in  the  specific  estimates,  the  cost 
per  pilot  graduate  with  adjustment  for  attrition  has  been  placed  at  S'.  1,829.'  This  estimate  does  not 
include  the  addition  of  costs  by  Headquarters  USAF  to  cover  depot  maintenance  and  centrally  funded 
replenishment  spares.  The  average  training  cos'  directly  attributable  to  each  elimination  from 
undeigraduate  pilot  training  (UPT)  has  been  estimated  to  be  approximately  $16,082.  With  costs  of  this 
magnitude,  any  selection  program  designed  to  identify  potential  eliminees  could  result  in  considerable 
savings. 

A review  of  attrition  rates  reveals  that  the  number  of  training  eliminations  in  UPT  varies  by  source  of 
commission.  As  shown  in  Table  1 , UPT  trainees  from  Officer  Training  School  (OTS)  represent  the  largest 
percentage  of  eliminees  while  trainees  from  the  Air  Force  Academy  (AFA)  have  tlvc  lowest  washout  rate.  A 
further  look  at  trie  causes  for  attrition  of  OTS  pilot  trainees  indicates  that  tlte  two  main  reasons  for 
elimination  are  (lying  deficiency  and  self-initiated  (i.e.,  voluntary)  elimination  (Table  2).  An  investigation 
of  the  factors  related  to  (lying  deficiency  might  include,  in  addition  to  the  traditional  aptitudes  required  for 
pilot  trainees,  motivational  factors  such  as  the  desire  to  become  a rated  pilot  and/or  an  expressed  interest  in 
flying.  The  self-initiated  elimination  (SIE)  appears  to  represent  a distinct  motivational  component  since  tills 
type  of  elimination  is  initiated  by  the  student  himself  rather  than  instructor  pilot  or  superior.  It  would 
seem  that  the  correlates  of  behavior  related  to  Utese  two  main  causes  for  elimination  should  indude 
non-cogiiitive/non-inteilectua]  factors  in  addition  to  cognitive  abilities,  and  that  the  use  of  non-cugnitivc 
data  in  the  selection  of  applicants  for  pilot  training  would  make  the  selection  process  more  cost-effective. 

In  Navy  research,  the  usefulness  of  biographical  said  interest  inventories  have  also  been  studied  quite 
extensively  (Abrahams  & Neumann,  1971a,  Abrahams  A Neumann,  1973;  Abrahams,  Neumann,  & Dann, 
t9t>9,  Abrahams,  Neumann,  & Git  Item.  1968; Dann  & Abrahams,  1970;  JoUaipa,  I960;  Neumann.  Githens, 
& Abrahams.  1%7),  Scales  developed  from  tlte  Strung  Vocational  Interest  Blank  (SV|U)  were  fount!  to  l» 
valid  in  identifying  early  motivational  UtienroBecs  Item  the  Naval  Academy,  assessing  the  career  motivation 
among  NRO't’C  applicants,  and  predicting  NROTT  officer  retention  (Abrahams  & Neumann.  |9?lh; 
Abrahams  & Neumann.  1973;  Abrahams,  Neumann,  & Dann,  1969;  Abrnhants,  Neumann.  & GitHens, 
1968).  Use  of  background  information  was  also  found  to  have  sufficient  predictive  validity  for  tlte  NROTC 
selection  program;  however,  research  using  biographical  ami  interview  data  to  identify  attritions  from  die 
Naval  Academy  indicated  that  interest  data  from  rite  SV1B  wa  fat  mo<e  predictive  (Dann  & Abtahat'ti, 
1970.  Neumann,  Gilberts.  & AUrahaiva,  1967). 


TtiNc  /.  Attrition  Rates  in  UPT  by  Source 
of  Coomusrioo  for  197|  --  1973* 


V«, 

S«unM  •*  Citnwltoan 

•rnotc 

OTS 

nr* 

t«r*i 

197t 

21.  <7. 

36.4*5 

9. 15- 

29.1*5- 

(972 

20.6*5 

38.5*5- 

12.8*5- 

28.1*5 

1973 

22.6*5 

36,0*5 

1 4.4*5 

27.2% 
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Table  2 Types  of  Training  Elimination  for  Students  in  UPT  1971  - 1973* 


Typ*  Elimination 

1971 

1972 

1973 

N 

% 

N 

% 

N 

% 

Hying  Deficiency  (FLY) 

562 

49 

484 

51 

297 

51 

Academic  Deficiency  (ACAD) 

17 

2 

4 

0 

10 

2 

Medical  Elimination  (MED) 

143 

12 

116 

12 

53 

9 

Manifestations  of  Anxiety  (MOA) 

129 

1 1 

107 

n 

53 

9 

Self-Initiated  Elimination  (SIE) 

295 

25 

222 

24 

159 

28 

Fatality 

5 

0 

2 

0 

) 

0 

Othei 

7 

1 

13 

") 

7 

1 

Total  Eliminated 

1,158 

too 

948 

100 

580 

100 

furnished  by  Hq  ATt\  Training  Analysis  Division. 


In  previous  Air  Force  research,  it  was  generally  concluded  that  biographical  and  interest  data  was 
positively  related  to  successful  military  outcomes  (Mullins,  Ewing,  & Woods,  1962;  Taylor,  Murray,  & 
Ellison,  1971;  Tupes,  1952,  1957.  Usdin  & Shenk,  1973).  In  the  study  by  Taylor  et  al.  (1971X  it  was 
recommended  that  further  research  on  the  development  of  motivational  assessment  tediniques  for  pilot 
t'alnlng  using  biographical  information  be  initiated.  When  a positive  relationsldp  was  found  between 
background/interest  measures  and  expressed  career  intent,  Usdin  and  Shenk  (1973)  also  recommended  that 
tire  study  of  lire  overall  utility  of  background  and  interest  measures  be  extended  to  include  validating  tltese 
instruments  against  training  criteria. 

Therefore,  the  purpuse  of  tire  current  study  was  to  (a)  develop  biographical  and  interest  keys  for  an 
Air  Force  sample  of  OTS  pilot  trainees  with  different  training  outcomes;  (b)  assess  tire  validity  of 
biographical  and  interest  keys  developed  against  tire  criterion  of  expressed  career  intent  for  pilot  training 
criteria,  and  (c)  validate  and  assess  tire  value  of  non-cogsdUvc  data  in  predicting  graduation/cUirriaation  in 
pilot  training. 


It  MniKH) 

A total  of  $95  officers  who  entered  pilot  training  in  Classes  733)2  through  7J-09  comjnired  tire 
sample  jmpttlatitm.  These  officer*  hat)  received  their  emmniwion  by  eomptetlng  lire  1 2<w«k  OTS  pvogram 
for  college  graduates  during  tire  latter  pair  of  197) . While  lit  the  tvffloer  training  program  at  lackland  AFO, 
Texas,  these  students  were  administered  tire  SVIO  ami  air  Oifioer  Biographical  and  Altitudinal  Suivey 
(OBAS). 

lire  SViU  is  an  empirically  scored  inventory  based  on  patterns  of  tikes  and  dislikes  designed  to 
• :v.;v.itsh  .sitting  various  occupation*.  Them  are  $4  occupational  keys  and  five  sujiptenwiilal  keys,  lire 
o,;AS  tx  a IKvitem  inventory  which  contains  background  atid  oUttudiiul  Items  including  tire 
hngkutaoog-potsibdity  scale,  lire  importance-possibility  scale  is  a group  of  43  items  which  requests  the 
respondent  to  indicate  tire  importance  of  certain  career  needs  and  the  extent  to  which  these  needs  can  be 
fuliUted  in  an  Air  Force  job. 

Kesporuc  data  from  tlrese  test  measures  were  keypundwd  and  transferred  to  tape  files  for  analysis. 
Data  from  tire  two  Inventories  ahsog  with  aptitude  scores  rctriewd  from  Use  officer  tape  files  comprised  the 
predictor  measures  uted  in  the  analysis  phase  of  this  project. 

Criterion  data  from  UFT  was  also  obtained  from  tlw  officer  tape  frks  maintained  by  the 
Computational  fkknoffs  Division,  Ait  Force  Human  Kcsources  laborahwy  (AFHftL),  lackland  Air  Faroe 
Base,  Texas.  Criteria  used  in  tlw  analyses  were  selected  after  a review  was  made  of  tlw  different  training 
outcomes  in  tire  sampfc  population.  Each  criterion  selected  represented  a different  attrition  category  being 
compared  to  tlw  success  group,  lire  number  oi'  cases  in  etch  amitioo/sucocss  category  during  the  three 
phases  of  UPT  arc  shown  in  Table  3.  Bared  on  these  data,  separate  .xuiyscs  by  training  phase  were  not 
considered  feasible. 
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Table  3.  Training  Outcome  of  Sample  Population  by  Training  Phase 


Tnlntat  Him* 


i ntmni  vit  ^uitw 

CUatlflcrVlon 

T-41 

TJJ 

T-a* 

ToUl 

Attrition  Category 

Academic  Deficiency  (ACAD) 

3 

1 

4 

Military  Training  Deficiency  (MTD) 

1 

1 

Hying  Deficiency  (FD) 

43 

28 

33 

104 

Medical  Deficiency  (MED) 

5 

10 

1 

16 

Self-Initiated  Elimination  (S1E) 

12 

45 

6 

63 

Fear  of  Flying/Manifestation  of  Anxiety  (MOA) 

3 

13 

1 

1? 

Other  (OTHER) 

2 

2 

Total  Number  of  UPT  Attritions 

207 

Success  Category 

Total  Number  of  UPT  Graduates  (GRAD) 

386 

Total  UPT  Sample 

543 

Final  selection  as  a criterion  was  based  on  the  hypothesized  relevance  of  the  criterion  to  tire  research 

objectives  or  the  number  of  subjects  available  in  one  or  more  of  the  attrition  categories.  As  large  a number 
of  subjects  as  possible  in  the  criterion  classification  was  desirable  to  permit  meaningful  analyses  am)  to 
increase  tire  stability  in  key  development  and  probability  of  obtaining  signiRcarrt  results  in  the 
cross-application  analy»«t.  Criterion  Group  1 included  all  types  of  eliminees  and  those  wlru  graduated. 
Criterion  Group  2 was  composed  of  UPT  flying  deficiency  eliminees  and  successfid  graduates.  Criterion 
Group  3 contained  those  wlw  elected  to  elitnlnate  themselves  (SU)  and  UPT  graduates;  Criterion  Group  4 
included  thus*  classified  as  motivational  attritions  (Slli  arid  MOA)  a tong  witir  the  success  group.  AU  four 
criterion  groups  were  used  in  die  item  analysis  phase.  Criterion  Group  1 was  used  for  the  regression 
analyses.  Table  4 delineates  the  composition  of  criterion  categories. 


rate  4. 

Ccuapo&Utett  of  Criterion  Categoric* 

C*H*ft*« 
Qt*«A  HumM* 

7«W* 

H 

Uvu<M4  l«aw*44  t*  cm*****  QMw» 

ACAD 

MVO  I'D  MU)  irt  UOA 

OSWM 

u**a 

1 

$43 

x 

X X X X X 

X 

X 

2 

440 

X 

X 

3 

449 

X 

X 

4 

•m 

X X 

X 

1110  sample  jxtpuUHon  was  scored  on  the  standard  SV1B  scale*,  and  keys  developed  previously  by  the 
Air  Force  (Sftenk,  1473)  were  applied  to  the  fmprirt*twe-po«fbfflfy  section  of  Ore  DBAS.  Definition*  and 
weights  used  to  generate  there  semes  are  contained  in  Appendix  A.  Two  additional  keys,  S»VlD/PUot  and 
OfiAX/Pttot,  which  were  developed  by  Usatn  and  Shsnk  (1473)  against  a criterion  of  expressed  career 
intent,  vrere  also  included  to  ds^ennine  llwh  validity  against  pilot  training  criteria. 

Item  and  «rgterak»  analytes  were  accomplished  to  develop  keys  for  piloJ  training  criteria  and  to 
asters  fire  usefulness  of  these  mut-ougpitive  measures  alone  and  in  cawbination  with  operational  aptitude 
mesaufts  in  predicting  pilot  training  outcomes. 

To*  item  analysis®  the  total  survey  respondent  population  was  divided  into  two  sample*  {half-sample 
1 (US,)  and  half -simple  2 (US}».  Using  these  sample*,  keys  west  developed  hated  an  item  criterion 


5TVc  i<«v>  miiyiis.  f »«  nrijwudbf  <Vwt.-f.td  Wttict  O-V'tiy-Mww  by  it,*  S*nrk»  ttuntt  (VslfdmVv* 

(tttMttfi  AV'Ul  (COS  JTSS))  *oJ  fcf  tWv  W*s«k»«4  CSwwtd  wri  riohes  ttatrrwbwg.  AHtRl.  t’«  Uus  pmjtit 

-dw  prugtaw  *u  iKtdiikd  by  the  V«mfw49XHXut  Skuwn  l)ow»  lo  tit  <wmm<xU«  a dWoTawwat  ctiuxia*. 
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validity,  a composite  was  built  by  selecting  keyed  items  in  a sequence  to  yield  maximum  prediction;  and  a 
cross-application  of  keys  and  item  sequences  was  accomplished  to  insure  stability  from  sample  to  sample. 
Omitted  responses  were  considered  as  a valid  alternative.  The  01  signficance  key  was  selected  for  use  in  the 
validation  and  cross-application  phases.  Items  were  keyed  based  on  the  validity  coefficient  for  cadi  item 
alt“mative.  Alternatives  were  keyed  +1,  -1,  or  0,  depending  on  the  significance  and  sign  of  the  validity 
coefficient. 

Regression  analysis  (Bottenberg  & Ward,  l%3)  was  utilized  for  the  model  seeking  phase  to  sleet  the 
optimal  set  of  predictors.  Three  models  containing  those  predictor  variables  found  to  make  the  most  valid 
and  unique  contribution  to  prediction  of  pilot  training  success  were  cross-applied  to  estimate  the  stability 
of  the  predictor  composites.  An  optimum  cutoff  score  in  the  predicted  score  range  was  determined  for  each 
model  winch  would  maximize  the  identification  of  potential  eliniinees  to  the  minimum  exclusion  of  pilot 
graduates.  Finally,  a distribution  of  predicted  scores  for  graituaies  and  climinccs  was  accomplished  to 
determine  the  number  of  pilot  trainee  outcomes  correctly  or  incorrectly  identified  by  llte  selector 
composites'  cutoff  score. 


HI.  RfrSUl  t'S  AND  DISCUSSION 

Const  met  ion  and  Cross- Validation  of  Keys 
front  Biographical/ At  titiulinal  Data 

F'mi!  separate  keys  were  developed  from  the  response  data  ot  tlie  OBAS:  Total  Elimination  (TE); 
Flying  tJelleieney  (ED),  Self-Initiated  (Sit),  and  Motivational  Deilciency  (MO).  As  shown  in  Table  5,  the 
validity  for  rite  TF  key  is  .37  for  the  criterion  using  only  seven  of  tlie  OBASltcnv..  Crw,ss<applying  the  TE 
key  yields  a validity  of  .13.  While  the  decrease  in  the  absolute  sire  of  the  validity  coefficient  wassirsabk, 
tlie  significance  of  the  validity  coefficient  upon  cross-application  reached  tlie  .05  level.  Similar  results  were 
obtained  for  the  FI)  key.  Die  original  validity  was  .40  but  decreased  to  14  when  cross-applied.  For  those 
keys  designed  to  tap  the  motivational  component  of  etiiiunee  behavior  (S|E  and  MO  Ah  the  results  of 
errsv-vatidjUiM'  u ere  not  encouraging.  Although  validities  of  .33  and  .37  were  obtained  for  the  original 
keys,  cross  apply  ng  these  keys  resulted  tn  vatidity  coefficients  of  ,iW<  for  both  key's  which  were  ri"t 
sigmtUaut  at  the  05  level.  Nevertheless,  thew  keys  wight  t>e  toed  advantageously  in  combination  with 
aptitudmal  and/or  tine  rest  data  once  they  tap  ansa*  of  background  and  altitudinal  inhumation  not 
presently  included  in  operational  selection  test* 

/-‘Wr  3 C mupowte  and  Ovws*  Validates  of  OttAS  Keys  foe  UFT  iiiinu 


I'.MMSO 

N(« 

n*.,  ** 

IbHH 

e«i*asut« 

V*M«» 

<Sw*r- 

VUMMty 

Total  1 liman*',  on 

TF 

7 

jki«4** 

.131')* 

l iving  ikiiacncy  Flmunaiioo 

Ft) 

t 

%•* 

.1 597* 

Self-Initiated  Elimination 

SIT 

6 

,3249** 

ri5&0 

Motivational  Deficiency  Flinrination  ISIF/MOA) 

Mi) 

$ 

.36WF** 

.on  r* 

ja  CO  Irtwt 
41  1*1  !.,<! 


Validity  of  SVltt  IHia  and  At  SVU1  and  OttAS  Keys 
agaiou  PUol  IrxuuctC  Criteria 

In  the  attempt  to  build  a predictor  eomjxwile  of  cBtninarion  keys.  SV)|)  keys,  and  key's  develop*;!  on 
previous  Air  Fores  Minjdes,  it  became  apparent  that  the  variables  for  the  proposed  composite  would  have 
to  be  reduced  to  a murage  able  number,  the  first  step  to  obtain  this  objective  wj*  to  reduce  the  $9  SVU) 
keys  to  a miniittem  nun  diet  which  were  significantly  related  to  the  overall  criterion  of  chminalrin  from 
(Hint  twining.  the  correlations  between  the  criterion  of  elimanatwm  and  the  keys  sued  in  this  study 
(Presented  in  Table  6)  w*te  not  high  enough  to  suggest  use  of  only  one  of  the  keys  as  a single  prediction 
instrument,  frit  the  entire  sample  of  $93  pdof  trainees,  the  bVUFdcuved  score  with  the  hipest  validity 
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Table  6.  ( of relations  Between  SVIB-Scales/AF  Keys  and  Elimination  from  UPT 


SciM/K*y 

Correlation 

Sea  l« /Kay 

Correlation 

Occupational  Scales-  SVIB 

Occupational  Scales  -SVIB 

Dentist 

.0514 

Officer  Worker 

.0487 

Osteopath 

.024  1 

Purchasing  Agent 

- 0557 

Vetennarian 

.oi)i  r* 

Banker 

-.0062 

Physician 

.0115 

Pharmacist 

.0162 

Psychiatrist 

- .0638* 

Mortician 

-.0127 

Psychologist 

.0892** 

Sales  Manager 

.0272 

Biologist 

.0358 

Real  Estate  Salesman 

.0107 

Architect 

.0051 

Lib  Insurance  Salesman 

- .0045 

Mathematician 

.0282 

Advertising  Man 

.0834"* 

ITiyacist 

.0073 

Lawyer 

.1106** 

Chemist 

.0568 

Author-Journalist 

-.1  ll>0** 

Engineer 

.0642* 

President.  Mfg  Concern 

-.0042 

Production  Manager 

.1057** 

Credit  Manager 

,0388 

Army  Officer 

.1474** 

( number  ol  Commerce  Executive 

-.0072 

Air  f orce  Olllcer 

.1461** 

Physical  lltetapist 

.0409” 

Carpenter 

.0654* 

Computer  Programmer 

.1550** 

forest  Seivt-.e  Man 

.044 3*  • 

Business  Education  Teacher 

.0004 

Farmer 

.0472 

Community  Recreation  Administrator 

.0.565 

Math-Science  Teacher 

.0273 

Psuter 

.0422 

Non  occupational  S«ite»-SV}U 

IVUceman 

.04  CM 

Spedali/atiun  lasxxr) 

-.0653* 

Persoiu  1 Director 

.0462 

Occupational  level 

.0402 

Public  Administrator 

0604 

Masculinity- Eciiumty 

.1508** 

Rehahititatkin  Counselor 

.0628* 

Academic  Achieve  tmnt 

,0707* 

VMt'A  SecteUtv 

.0308 

Occupational  Intmwtdiamtxituvetsion 

-.0346 

Social  Worker 

0863** 

Social  Teacher 

.0404** 

OB  AS  liupnrunce-ftwihiify  Key* 

School  Superintendent 

.044#.** 

Total  (W&tllty 

.0100 

Muvistet 

,044 1** 

Total  Severe 

.0257 

librarian 

22)8** 

Zero  Etetpumcy 

.0084 

Atmt 

,0244 

Pckuuve  Score 

,0302 

Musician  Petfremer 

-.0286 

Punitive  Frequency 

.0003 

Music  Tea  else  r 

-.1144** 

Cl’A  Owner 

-,0724* 

JivmMot  Key 

0067 

SeiUot  vPA 

.0855** 

OUAS  Pilot  Key 

.0114 

Accountant 

,0412 

*S'*C*Ut«ikl  »•  OS  l(« 

t. 

#t  .01  level. 


with  (He  UPT  pass /fall  a He non  was  the  librarian  sciteC  -22).  Although  t*w  Ait  Entce  officer  key  showed  a 
relatively  lew  relationship  with  the  UPT  critenr-o  (.15).  it  may  he  that  thU  key  is  mote  predictive  of 
ooo-uted  success  in  the  Ait  Etwee.  Results  of  ?«£iessH#i  enalysik  to  identify  the  minim um  number  of  SVJB 
wfct  which.  when  combined,  ate  mott  predictive  of  unless  in  pilot  itahullp  indicated  that  1 7 scales  which 
produced  a multiple  csntelatum  of  AS  with  the  ctf  tetion  appealed  to  he  the  optima)  number  The  scales 
teketed  iur  futthet  tegreuiw.'  analyses  art;  listed  in  Yabk  7. 

None  of  the  import  ance-potabdity  scenes  which.  in  ptevims  research,  had  shown  a Mjmifiant 
relatimuhip  with  hath  etieer  intention  (Usd  if,  & Sheok,  147?)  and  actual  eamt  statu#  (Shcnk,  1473)  tot 
found  if  he  tsgnifkantly  related  to  the  pilot  training  cuter  ton.  The  iriliiftnei  and  bickground/atlitudiftal 
key  s developed  wo  the  sainpic  to  predict  expressed  career  intent  showed  almost  no  rciationdUp  with  the 
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lablt?  7.  Cumulative  Multiple  R 
and  R5  for  17  SVIB  Saks 


C.umuUtlv* 


Scat* 

2 

R* 

1 jhranan 

.2:3S 

.0501 

Musician 

.2585 

.0668 

rltanmasi 

2854 

.0815 

Computer  Program’ n;r 

.3024 

.0415 

life  Insurance  Salesman 

.3267 

.‘067 

Hr  y si  cal  Therapist 

.3357 

.1127 

Math/Science  Teacher 

,34l?7 

.1223 

Public  Administrator 

.3669 

.1346 

Accountant 

.3762 

.1415 

Of  lice  Worker 

3H‘->2 

.1515 

Aathor/Joumalist 

.4020 

1 0 1 6 

Carpenter 

.4126 

.1702 

lVrrtist 

,41‘C) 

.J7f4 

Orteopath 

.4728 

.18  73 

Advertising  Mart 

.4378 

,1916 

CPA  Owner 

.4435 

1%7 

Banker 

.>4483 

2010 

UPT  etiierUsn.  Mawewt,  though  the  uuiicmor*  of  career  potential  haw  tit  tie  or  no  relattiMtslup  to  UPT 
diciutretiuiCgtaduatum,  the  usefulness  of  m tudwatw  of  pemmnel  retain  ahtbtv  should  n«?  t»  overlooked. 
If  the  SVUVtinpnttaRce-pnsnthdtty  keys  at?  found  to  retain  the  same  reUtiuitship  with  actual  career 
decision  as  that  shown  ut  pre*tvntt  research  on  expressed  career  intent,  there  keys  could  he  effectively 
incorporated  into  tire  proves*  he  wtectfcm  to  pilut  training.  initial  selection  would  he  bated  essentially  tnt 
aptitudes  and  other  tu«rt«>|svmie  data  predictive  of  pilot  training  sueoess.  If  the  selection  ratio  of  those 
qualifying  on  these  measure*  a favorable,  (Inal  selection  based  utt  suttvt  indication  of  reuinabihty  could  he 
used  to  masimree  the  Ait  hotce  return  tan  a crassly  i reining  investment. 

iokvtsH*  of  Optima!  Selection  Composite 

(n  developing  a reWct  rent  vnmpnple  for  opetaHotul  use.  an  evaluation  m*»st  he  made  of  tty-  potential 
saving*  which  tnigftt  he  accrued  hy  the  t&KitfWsHott  and  rejection  ot  prt«ihfc  ehffihvees  ugaent  the 
additional  c*«t  in  time  and  money  in  imptemenitop  the  proposed  screening  system,  the  use  of  the  SVIB 
and/or  OtiAf*  tn  addition  l«  the  Aft  Cotoe  Offkst  thwbf*in|  Test  (AWW'f)flrm  in  ure  uonld  increase  thv 
overall  cost  of  the  operational  testing  ptogtam,  Therefore,  tome  attention  *3* directed  t res  aid  rtanimidtig 
the  nund'Ct  of  measures  width  would  he  requited,  yet  nusimiwiqj  the  tdemUSkatron  el  posShk  ehmltrec*. 

the  fust  slept  it»  developing  an  optimal  composite  of  prcdictr**  lot  use  tn  refection  of  pilot  trainees, 
was  to  defettAUw  whether  each  predictor  or  fjoap  of  predictor*  made  a tigniftciot  cswtrihuUoo  in 
predicting  graduation /elimination  from  pilot  training.  A summary  of  regre.«fon  analyses  is  presented  in 
Table  K. 

Results  of  regtesaon  problem*  1 and  2 fndscate  the  17  SVJft  sates  usd  ORaS  chmiocc  km  made  a 
sipif*c«H  contribution  to  the  prediction  of  the  aitenon.  hi  p-oldcm  J,  it  re»  found  that  the  SVUl  Riot 
Key  and  OttAS  lays  pniviouUy  developed  on  a criterion  of  esjiressed  carttt  intent  were  not  ligoifresaiiy 
related  u?  the  pws/fail  criterion  Comtnnalton*  of  the  SVfB  scale*  mvifttr  OBAS  key’s  with  the  Af'OQY  pilot 
cmtvpoBlr.  «re  also  sigpifkant  at  the  .01  level  t .vof’stm  4,  5,  awl  6t  tn  comparing  the  effectiveness  of  the 
non  cophtwe  data  with  the  Af  OQt  Rkrl  Cotnpodtc  (problem*  7.  8.  and  9),  ft  was  found  that  the  SVUl 
sates  and  cUmtocv  keys,  akne  and  to  cnrrihlnstinn.  nuke  a unique  and  sigaifteaeit  cxminbwk**  to 
prcdkijve  accuracy  over  and  share  the  Ai  tXJT  Riot  fompowte.  On  the  other  result*  of  regjeoion 
problem  S')  indicafc  the  pilot  composite  aiu»  make*  a Significant  oaniishuUon  osier  and  atwnre  the 
mm-cggniliw  data. 
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Table  <5’.  Summary  of  Regression  Analyses 


Problem 

UPT 

Criterion 

■ — ■■ 

Full  Model 

Rettrlcted  Model 

<«. 

df3 

F Ratio 

R1 

Predictor* 

Ra 

Predictor* 

1 

Pass/Fail 

.2009 

17  SVIB  scales 

.0000 

_ _ 

17 

278 

4. 1 1 • * 

2 

Pass/Fail 

.1674 

4 OBAS  Etiminee  keys 

(TE,  FI3,  SIE,  MO) 

.0000 

- — 

4 

291 

14.62’  * 

i 

Pass/Pail 

.0049 

Career  intent  keys 

(S  OBAS,  1 SVIB  Pilot  Key) 

.0000 

— - 

6 

289 

.2495 

4 

Pass/ Fail 

.3038 

1 7 SVIB  scales,  4 OBAS  Elim 

keys,  AFOQT  Pilot 

Composite 

.0000 

— - 

22 

273 

5.41** 

5 

Pass/P  ail 

.2146 

n SVI B scales,  Sc  AFOQT 

Pilot  Composite 

.0000 

- — 

18 

277 

4.20** 

6 

Pass/ fail 

.1460 

4 OBAS  Kli  mince  keys  & 

AhOOT  Pilot  Compocitc 

.0000 

— 

5 

290 

14.14** 

7 

Pass/Pail 

.3038 

17  SVIB  Scales,  4 OBAS 

Elim  keys  & AFOQT  Pilot 

17  SVIB  scales 

Composite 

.2922 

& 4 Elim  keys 

) 

273 

4.52* 

8 

Pass /Fa  il 

.3038 

17  SVIB  scales,  4 OBAS 

Elim  keys  Sl  AFOQT  Pilot 

Composite 

.2009 

17  SVIB  scales 

5 

273 

8.06*» 

9 

Pass/Fail 

.3038 

17  SVIB  scales,  4 OBAS 

Klim  keys  & AFOQT  Pilot 

Composite 

.1674 

4 OBAS  Elim  keys 

18 

27  3 

2.97** 

10 

Pass/ Fail 

.3038 

17  SVIB  scales,  4 OBAS 

Elim  keys  & AFOQT  Pilot 

AFOQT  Pilot 

Composite 

.0396 

Composite 

21 

273 

4.93** 

‘Significant  at  .OS  level. 

* ‘Significant  at  .01  level. 

based  on  these  results,  it  appears  that  adding  one  or  both  of  the  non-cognitive  measures  to  the 
AFOQT  Pilot  Composite  in  the  selection  of  pilot  trainees  would  be  cost-effective.  However,  in  evaluating 
the  potential  benefits  of  additional  screening,  some  attention  should  be  directed  toward  the  practical  rather 
than  statistical  significance  of  a new  selection  procedure  which  would  include  the  administration  of  one  or 
two  additional  measures.  For  this  purpose,  three  models  of  predictor  variables  were  formed,  and  the  relative 
effectiveness  of  each  model  as  a screening  device  was  assessed.  Model  1 included  all  three  components:  17 
SVIB  scales,  four  OBAS  keys,  and  the  AFOQT  Pilot  Composite.  Using  all  22  predictore,  a final  multiple  R 
of  .S5  was  obtained;  an  R of  .14  in  the  cross-application  phase.  Model  2 combined  the  17  SVIB  scales  and 
AFOQT  Pilot  Composite.  These  18  predictors  produced  a multiple  R of  .46;  .1 1 on  cross-validation.  Model 
3 was  comprised  of  the  four  OBAS  keys  and  the  AFOOT  Pilot  Composite.  For  this  model,  the  multiple  R 
obtained  on  the  validation  sample  was  .44  with  .14  on  cross-validation.  Tire  obtained  correlations  in  the 
validation  and  cross-validation  samples  were  statistically  significant  at  or  beyond  the  .05  level  with  the 
exception  of  the  cross-validity  for  Model  2. 

It  is  realized  that  the  magnitude  of  the  multiple  correlation  decreases  when  the  predictor  composite  is 
used  on  future  samples.  However,  it  should  also  be  noted  that  the  correlation  obtained  on  the  sample 
population  previously  screened  by  an  operational  selection  test  is  somewhat  lower  than  if  it  had  been 
computed  on  an  unrestricted  population.  From  these  results,  Models  1 and  3 appear  to  demonstrate  some 
usefulness  in  the  selection  of  potential  pilots. 

Identification  of  Pilot  Training  Eliminees 

Based  on  the  regression  analysis,  it  was  concluded  that  the  combination  of  aptitude,  interest,  and/or 
biographical  data  into  a P-lot  Selection  Composite  (PSC)  could  function  as  a screening  tcclmique  to  identify 
trainees  who  might  be  potential  failures, 

To  estimate  the  correct  classification  rate  and  potential  value  of  these  psychometric  measures,  they 
shou'd  be  applied  to  a sufficient  number  of  new  trainees  entering  pilot  training.  However,  since  tiie  number 
of  pilot  eliminees  is  relatively  small  and  due  to  the  tune  required  to  obtain  an  additional  sample,  It  was 
decided  to  assess  the  usefulness  of  the  three  predictor  composites  on  the  total  sample  even  though  a portion 
of  the  total  sample  had  heer.  used  for  the  key  development  or  the  model  seeking  analyses. 

The  overall  statistical  significance  of  a predictor  composite  often  does  not  reflect  the  actual  practical 
value  :,f  a scree., ng  tcduiique.  A more  useful  assessment  of  the  PSC  models  can  be  made  by  a comparison 
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of  the  number  of  pilot  trainees  whose  outcomes  are  correctly  identified  (i.e.,  hits)  versus  the  n unber  of 
pilot  trainees  incorrectly  classified  (i.e.,  false  positives  and  misses)  Ibis  include  all  personnel  identified  as 
graduates  who  have  successfully  completed  pilot  training  and  those  identified  as  potential  el'i  .inee.:  who 
did  att.it  front  training.  False  positives  include  those  successful  graduates  who  were  identified  as  potential 
elintinees;  misses  include  eli  minces  classified  as  successful  graduates. 

Predicted  scores  based  on  the  weighted  linear  combination  of  the  variables  in  the  three  models  were 
obtained  for  all  593  subjects.  Cutoff  scores  for  the  three  models  were  computed  wb.ch  differentiated 
between  pilot  trainees  who  would  not  he  eliminated  it  some  phase  of  UPT  front  those  vho  would  have 
difficulty  in  completing  this  training  program.  Table  9 shows  the  possible  utility  of  tne  PSC  models. 


Table  V.  Predicted  Versus  Actual  Outcomes  for  Three  Models* 
of  the  Pilot  Selection  Composite 


Predicted  Outcome 

Model  Actual  UPT 

Number  Outcome 

Success 

Fil.ure 

TotJl  Group 

N 

% 

N 

% 

N 

% 

1 Success 

N 

349 

7’ 

37 

32 

386 

65 

*•; 

00 

10 

100 

tints] 

(false  positives) 

Failure 

N 

i:« 

27 

78 

6" 

207 

35 

% 

38 

100 

(misses) 

(hits) 

Total 

478 

MO 

113 

100 

593 

100 

SI 

19 

100 

2 Success 

N 

360 

6S 

26 

40 

386 

65 

% 

9?. 

7 

100 

(hits) 

(false  positives) 

Failure 

N 

169 

32 

38 

60 

207 

35 

r( 

s: 

18 

100 

(misses) 

(flits) 

Total 

N 

5 :«> 

UK) 

(v4 

100 

593 

UK) 

•S 

89 

1 1 

UK) 

.1  Success 

N 

310 

73 

76 

45 

386 

65 

SO 

20 

UK) 

(hits) 

(false  positives) 

Failure 

N 

113 

94 

55 

207 

35 

74 

55 

45 

100 

(misses) 

(hits) 

Total 

\ 

423 

100 

170 

UK) 

593 

UK) 

7) 

29 

too 

1 t 3 S VI  It  4 x tit  AS  kvn,  AltHlT  IMv»t  i 
M**vh  1 .*■  t ■ \\U\  to**  .jll/.  A I * H,»T  IM*«t  iiMupuMU . 
\ 4 H|\AS  lev*.  aihI  Af  tH>T  I’tlo? 
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PSC  Model  I.  Thirty-eight  percent  of  the  eliminecs  were  identified  by  Model  1 as  high-risk  for 
attrition  and  only  ten  percent  of  the  UPT  graduates  were  incorrectly  classified  by  the  PSC  Model  1 cutoff 
score  of  .49.  With  a favorable  selection  n»tio,  the  misclassification  of  ten  percent  of  a group  of  potentially 
successful  pilot  trainees  could  be  tolerated 

The  base  rate  of  successful  completion  of  UFT  in  the  population  sample  was  65  percent  (i.e..  386  of 
the  total  563  were  successful).  Using  the  predictor  composite,  the  rate  of  correct  classifications  of  UPT 
outcomes  (i.e.,  hits)  is  increased  to  72  percent. 

Table  10  shows  the  number  of  predicted/actual  UPT  outcome  classifications  by  specific  type  of 
eliminee.  Nineteen  percent  of  the  total  sample  was  labeled  as  high  risk  by  this  composite  cutoff.  Of  the  Id 
percent  identified  as  potential  failures,  68  percent  did,  in  fact,  eliminate  for  one  reason  or  another.  Among 
the  various  reasons  for  elimination,  over  40  percent  o*'  the  flying  deficiency  and  self-initiated  eliniinees  were 
identified  by  the  PSC  Model  1 cutoff  score.  Only  18  percent  of  die  fear  of  flying  category  was  identified  as 
high  risk.  Obviously,  the  primary  behavioral  characteristics  related  to  this  type  of  failure  were  not  tapped 
by  the  measures  included  in  the  proposed  composite. 

Table  10.  Descriptive  Statistics  and  Percentage  of  UPT  Trainees  Above  and 
Below  Cutoff  Point  on  Pilot  Selection  Composite  MODEL  l by  Training  Outcome 


Training  Outcome 
Type  Cumins 


UPT 
G WAD 

ACAD. 

MED 

OTHCF. 

FCV 

ste 

MO  A 

Tali. 

Total 

GrOUp 

Culofr  Scorn 

N Col  W 

N Col  * 

N Colic 

n coi  n. 

N Col  % 

N Col  % 

N Col  % 

PSC  • 49 
(P(*da  ta<i  Fatturel 

How  H 

37  10 

3? 

7 30 

6 

42  40 

36 

26  41 

23 

3 18 

3 

78  30 

68 

115  19 

100 

PSC  < .49 
(PfeUcitoil  Succwl 

How  Vi, 

349  90 

73 

16  70 

3 

67  60 

13 

37  63 

8 

14  82 

3 

129  07 

27 

476  31 

ICO 

Tourl  N 

Row  % 

3°6  100 

65 

23  100 

4 

104  100 

17 

63  100 

11 

1 7 500 

3 

207  100 

36 

593  100 

100 

Mean 

.7052 

.5791 

.5694 

6141 

5M« 

.6349 

.0458 

so 

.1729 

.1331 

.5180 

.2058 

.1002 

.1906 

.1966 

The  means  and  standard  deviations  of  PSC  Model  I scores  are  also  shown  in  Table  10.  Results  of 
Hests  Iwtwcen  die  means  of  the  graduate  group  ami  the  loss  groups  indicate  that  in  all  comparisons  the 
mean  differences  were  significant  at «?  beyond  the  .01  level, 

/$C*  M,hM  2,  Using  tlte  optimal  cutoff  score  of  .35.  only  16  percent  of  lire  eliniinees  and  seven 
percent  of  the  UPT  graduate  category  were  Identified  as  potential  failures.  While  classification  of  18  percent 
of  tire  eliminecs  would  decrease  costs  related  to  attrition,  this  mode!  does  not  appear  to  he  os  effective  m 
tire  Identification  of  potential  failures  as  the  other  two  models.  On  lire  other  hand,  this  model  has  the 
lowest  rate  of  misclassification  of  potentially  successful  pilot  trainees.  Using  this  model,  the  tate  of  correct 
classifications  of  UPT  outcomes  increase  from  the  base  tate  of  05  to  68  percent. 

As  shown  in  Table  11,11  percent  of  tire  total  sample  was  labeled  as  high-risk  for  pilot  training  using 
the  .35  cutoff  score.  Of  the  1 1 percent,  S’-*  percent  were  eliminated  from  training.  Hits  model  apt*tars  to 
Identify  approximately  tire  same  percentage  of  failures  in  the  different  eliminee  categories. 

Results  of  t -tests  between  the  means  of  the  graduate  group  and  the  toss  pimps  presented  m Table  1 1 
Indicate  that  in  all  comparisons  cxcetit  one  the  mean  differences  wetc  significant  at  or  beyond  the  .05  level. 
Die  ttuan  comparison  between  UPT'  graduates  and  eliminecs  due  to  feat  of  (lying  was  not  significant.  As 
indicated  previously,  tltis  mode)  appears  to  be  tlte  least  effective  as  a screening  device  for  idiot  trainees. 
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Table  1 1.  Descriptive  Statistics  and  Percentage  of  UPT  Trainees  Above  and 
Below  Cutoff  Point  on  Pilot  Selection  Composite  MODEL  2 by  Training  Outcome 


Training  Outcome 

Ty»e  Ellminee 


Outaft  icons 

UPT 

GRAD 

ACAD, 

MED 

OTHER 

FLY 

SIE 

MOA 

Total 

Total 

Group 

N Col  % 

N Col  % 

N 

Col  % 

N Col  % 

N Col  % 

N 

col  % 

N 

Col  % 

psc  - .3-; 

26  7 

5 22 

19 

18 

11  17 

3 18 

38 

18 

64 

11 

(Predicted  Pailure) 

Row  % 

41 

8 

29 

17 

5 

59 

100 

PSC  < 35 

360  93 

18  78 

85 

82 

52  83 

14  82 

169 

82 

529 

89 

(Predicted  Success) 

Row  % 

63 

3 

16 

10 

3 

32 

100 

Tota' 

386  100 

23  100 

104 

100 

63  100 

17  100 

207 

100 

593 

100 

Row  % 

65 

4 

17 

11 

3 

35 

100 

Mean 

.6645 

.5570 

.5377 

4940 

.5324 

.5261 

.6162 

SD 

.2140 

.2349 

.2086 

.1833 

2251 

.2076 

.2217 

TSC  Model  .1.  The  Model  3 optimal  cutoff  score  of  .51  identified  45  percent  of  the  failures  and  20 
percent  of  the  graduates  as  high-risk  for  attrition.  The  ^classification  of  20  percent  of  potentially 
successful  pilot  trainees  is  rather  excessive  lor  operational  use.  Using  PSC  Model  3,  the  rate  ot  correct 
classifications  of  UP!'  outcomes  is  increased  ,.om  the  base  rate  of  6S  percent  to  67  percent. 

Table  12  indicates  that  percent  of  the  total  population  would  be  identified  by  Model  3 as  high-risk 
person*  el.  This  t.uv’el  identities  a larger  number  of  personnel  as  high-risk  than  tire  other  two  models.  Ot  the 
70  percent  identified  as  high-risk.  55  perrnt  were  eliminated  from  training,  forty-seven  percent  ol  the 
flying  deficiency  category  and  48  pc, cent  of  the  SlEs  were  identified  by  the  PSC  Model  3 cutoff  score.  As 
with  she  other  model.,  the  fear  of  Hying  eategt  y ic  less  accurately  predicted  although  PSC  Model  3 
identifies  24  percent  of  this  category  as  compared  u<  18  percent  idortlfred  by  PSC  Models  I and  2. 


Table  IT  Descriptive  Statistics  «ul  Percentage  of  Ul’i'  Trainees  Above  and 
tklaw  Cutoff  Puhit  on  Pilot  Selection  f onipnsltt  MODEL  3 by  Ttalning  Outcome 


Tr*ttU*f  CHC  ;«n* 

Yyo*  KlOrUno* 


UPT 

Q**U 

Mgn 

CYH6B 

PWV 

• t 

134 

ToUl 

ToUl 

oxtep 

Curort  Scot* 

N C*4  V 

W Col% 

N Cots 

N Col*. 

N 

C«4  % 

N 

CiM* 

N 

PSC  ■ at 

76  20 

11  49 

*3  47 

30  43 

4 

24 

04 

46 

170  20 

iPfVKJtetud  FaJutol 

Rsw  '• 

<5 

6 

20 

18 

2 

56 

100 

PSC  51 

:to  so 

12  6? 

55  67 

,13  67 

13 

76 

(13 

\8 

423  ?! 

(ProdiawJ  Suocou) 

Row  \ 

73 

3 

13 

8 

3 

27 

100 

Touji 

386  100 

33  100 

«C4  100 

63  '00 

17 

100 

207 

KX 

693  100 

How  \ 

65 

4 

17 

n 

3 

33 

100 

,6615 

.6636 

6066 

.6000 

.6276 

6147 

SO 

.1966 

.1764 

3012 

.2100 

.150* 

.2033 

.2082 
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T-tests  between  means  of  the  graduate  group  and  the  loss  groups  presented  in  Table  12  indicate  that 
all  comparisons  between  graduates  and  elinunees  were  significant  at  or  beyond  the  .05  level. 

The  possible  monetary  savings  from  implementation  of  a selection  procedure  such  as  one  of  the  PSC 
models  can  be  demonstrated  by  using  the  sample  population  as  an  example.  A total  of  386  trainees 
graduated  from  pilot  training  in  the  OTS  sample  representing  65  percent  of  the  total  group.  Using  Model  1 , 
the  total  number  of  trainees  who  achieved  a predicted  score  of  .49  or  higher  was  478;  349,  or  73  percent  of 
this  group,  were  successful  graduates.  Assuming  that  386  graduates  were  required  to  meet  operational 
needs,  using  the  73  percent  success  rate  of  the  Model  1 PSC  cutoff,  a total  input  of  5.79  would  have  been 
required  instead  of  593.  Instead  of  the  original  207  climinees,  only  143  would  not  have  completed  pilot 
training.  Tire  original  number  of  eliminces  (207),  at  an  average  cost  of  SI  6,082  (see  Footnote  1)  per 
eliminee,  represents  an  approximate  cost  of  $3,328,974.  The  lowered  number  of  climinees  (143)  represents 
a cost  of  52,299,726,  or  a saving  of  SI  ,029,248. 

Although  the  required  input  and  number  of  climinees  change  using  PSC  Model  3,  the  possible  savings 
to  be  accrued  are  the  same.  This  finding  would  tend  to  indicate  that  the  additional  costs  associated  with  the 
administration  of  the  SVIB  are  not  warranted.  From  a cost  standpoint,  the  PSC  Model  3 is  more  effective 
than  the  other  two  models.  Tire  use  of  Model  3 would  avoid  the  purchase  and  administrative  time  of  a 
civilian  test  lor  screening.  Tire  only  drawback  in  using  PSC  Model  3 is  the  high  (20%)  misclassification  rate 
of  potential  UPT  graduates.  Hie  selection  ratio  would  have  to  be  highly  favorable  before  such  a screening 
procedure  could  be  used. 

Using  Model  2,  a total  input  of  568  would  be  required.  The  lowered  numbor  of  climinees  (182)  using 
tlris  model  represents  a cost  of  S2.926.924  or  a savings  of  S402.050  from  the  costs  associated  with  a total 
of  207  climinees. 

The  savings  based  on  tlris  sample  using  the  three  PSC  modols  are  given  for  illustrative  purposes  only. 
Although  the  savings  to  bo  accrued  from  the  total  UPT  input  would  be  sizeable,  the  cost  of  program 
administration  and  recruitment  to  obtain  a sufficient  number  of  high  quality  trainees  was  not  taken  into 
account.  It  is  also  recognized  that  the  savings  calculated  on  OTS  input  would  not  accurately  represent  the 
costs  associated  with  Input  from  AFROTC  and  APA. 


IV.  CONCLUSIONS  ANI>  WCOMUFNUATtONS 

Hie  correlations  obtained  for  the  PSC  models  appear  to  indicate  that  a screening  device  using 
non-cognitive  data  has  practical  value  in  tire  selection  of  pilot  trainees.  Obviously,  such  a system's 
effectiveness  would  Ire  related  to  the  availability  of  qualified  jiilot  applicants.  If  the  selection  ratio  In  the 
pilot  applicant  pool  becomes  less  favorable,  the  percentage  of  false  positives  for  fire  PSC  models  may  be  too 
high  to  warrant  their  use  in  the  selection  process. 

If  tire  number  of  potential  pilot  applicants  outnumbers  the  projected  need  lot  pilot  trainees,  the 
concern  about  exclusion  of'  false  positives  would  not  be  a limiting  factor  in  recommending  tire  use  of  I'SC 
Models  I or  3 in  an  operational  setting. 

Uased  on  tire  results  of  tlris  preliminary  study,  the  following  courses  of  action  arc  recommended: 

1.  Further  research  Ire  accomplished  on  a new  sample  of  pilot  trainees  to  revalidate  tire  OBAS  and 
SV1U,  lire  recent  change  in  the  UPT  curriculum  to  permit  tire  141  aircraft  phase  of  training  of  UPT  to  Ire 
accomplished  during  Officer  Training  School  necessitates  further  investigation.  Hie  present  study  did  not 
attempt  to  predict  tire  pass/fail  criterion  for  any  one  phase  of  training.  An  evaluation  of  tire  I’SC 
composites  on  successful  completion  of  the  T-41  phase  appears  appropriate  followed  by  research  on  tire 
usefulness  of  these  measures  in  tire  later  prases  of  UPT.  Simitar  studies  should  also  bo  accomplished  mi 
AFROTC  and  AFA  pilot  trainee  input. 

2.  In  the  next  revision  of  the  AFOOT,  items  found  significant  in  the  development  of  tire  OHAS 
elimination  keys  can  be  considered  for  incorporation  into  fire  Pilot  biographical  Inventory  portion  of  tlie 
operational  test. 

3.  lire  value  of  tlresc  screening  techniques  should  Ire  further  evaluated  by  considering  the  (a) 
feasibility  and  cost  of  administering  the  additional  tests,  (h)  Use  potential  savings  to  be  accrued  by  avoiding 
tire  training  cxjvuses  of  trainees  wi  o caiurot  complete  UPT,  and  (c)  the  iiit|»acl  of  tire  loss  of  potentially 
successful  |iUots. 


IS 
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APPENDIX  A:  DEVELOPMENT  OF  EXPERIMENTAL  SCORES 


Various  experimental  scores  were  generated  for  responses  to  the  Job  Importance -Job  Possibility 
Scale  (Shenk,  1973).  To  obtain  these  experimental  scores  the  following  weighted  values  were  first  assigned 


to  each  alternative: 

Alternative  Value 

Importance  Scale  Response 

Possibility  Scale  Response 

a 

1 

Not  important  at  all 

No  possibility  at  all 

b 

2 

Somewhat  below  average  in  importance 

Less  than  average  possibility 

c 

3 

Of  average  importance 

Average  possibility 

d 

4 

Somewhat  above  average  in  importance 

Better  than  average  possibility 

e 

5 

Extremely  important 

Very  good  possibility 

Using  these  weights,  the  following  experimental  scores  were  generated  for  each  subject: 

Total  Score  Algebraic  sum  (including  both  plus  and  minus  values)  for  the  weight 

applied  to  the  item  on  the  Possibility  Scale  subtracted  from  the  weight 
applied  to  the  same  item  on  the  Importance  Scale. 

Zero  Frequency  Hie  number  of  zero  differences  when  the  weight  applied  to  the  item  on 
the  Possibility  Scale  is  subtracted  from  the  weight  applied  to  the  same 
item  on  the  importance  Scale;  i.e.,  the  number  of  times  the  importance 
weight  was  the  same  as  the  possibility  weight. 


Positive  Frequency  The  number  of  positive  differences  when  the  weight  applied  to  the  item 
on  the  Possibility  Scale  is  subtracted  from  the  weight  applied  to  tiro  same 
item  on  tire  Importance  Scale;  i.e.,  the  number  of  times  the  importance 
weight  was  greater  than  tlie  possibility  weight. 

Positive  Score  Hie  sum  of  all  positive  differences  when  tire  weight  applied  to  the  item  on 
the  Possibility  Scale  is  subtracted  from  tire  weight  applied  to  tlte  same 
item  on  the  Importance  Scale; he.,  tlte  importance  weight  was  greater  than 
the  possibility  weight. 


Total  Possibility  Sum  of  ail  tlte  weighted  responses  for  items  on  the  Possibility  Scale. 
Score 
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Number 


First 

\tithor  Till*- 


\FIIRI.-TR-73-P*  (AO-775  71  0 Union  Effeel  of  an  All-Volunteer  Force  on  Input  into  tin; 

School  of  Military  Sciences.  Officer  Training 
Program 

<^,^/-\FIIRI.-TR-7(>-,>  (AD-A025  85l|  Uuinn  Background  and  Interest  Measures  as  Predictors  of 

Success  in  Undergraduate  Pilot  Training 

\FIIRI.-TR-77-3b  ( \D-A0I2  h8't)  Aalcnline  Navigator-Observer  Selection  Research:  Develop- 
ment of  New  Air  Force  Officer  Qualifying  Test 
Navigator-Technical  Composite 


\FIIRI.-TR-78-33  (\D-\058  118)  Hunter  Pilot  Selection  System  Development 

Due  to  scoring  errors  which  were  found  in  the  data  files  of  the  Air  Force  Officer  Qualification  Test  — 
F.  /ms  I..  M.  and  N.  all  analyses  using  aptitude  scores  uc/ived  from  these  test  forms  which  are  contained  in 
the  -object  technical  rejiorl'  alwixe  are  considered  erroneous. 
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